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ABSTRACT 

• As one of a series of sharply focused booklets based 

on cpncrete educational needs, this booklet provides teachers with 

♦educational theory and research on evaluating. classroom speaking and 
presents suggestions for, tfte~applicatxorr cf~rfcft e», theory in re g ular 

"classroom situations. The section on theory and research begins by . 
describing a raodelSrqf tHe evaluation process/ then discusses varipus 
rating errors in the' evaluation process. With the theoretical basis 
for rating and speech eva^tption in mind, the section 'on' practice 
examines several teaching issues that emerge when actually rating 
speeches in the clSTsstoooA setting. These issues include when and how 
to evaluate speaking performances, the modes of evaluation, who 
should make the evaluations, and suggestions for constructing an 
evaluation instrument • /The concluding section contains sample copies 
of 13* evaluation forms and descriptions o£ their intended' uses. A 
list of references is provided. lR£) 
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Foreword 

The Educational Resources Information Center (ERIC) is a national in- 
formation system developed* by the U.S. Office of Education and now 
sponsored by the National Institute od Education (NIE). It provides 
ready access' to descriptions of exemplary programs, reports on re- 
search and developmerj't efforts, and related information useful in de- 
veloping effective educational programs. 

. Through its network of specialized centers or clearinghouses, each of 
which is responsible for a particular educational area, ERIC acquires, 
evaluates, abstracts, and indexes current information and lists that in- 
formation in its' reference publications. 

The 'ERIC system has already made .available^ through the ERIC 
Document Reproduction Service— a considerable body of data, in- 
cluding all federally funded research reports since 1956. However, if 
the findings of educational research are to be used by teachers, much 
of the data must be translated into an essentially Afferent -context. 
Rather than resting at the point of making research reports easily "ac- 
cessible, NIE has 'directed the separate ERIC clearinghouses to com- 
mission information analysis papers in specific areas frpm, recognized ' 
authorities in those fields. 

As with- all Jfedejal educational information efforts, ERIC^ias as a 
primary goal briflging the gap between^ educational theory anci 
classroom pr^tice. One method of achieving that' goal is the devep- 
ment by tWERIC Clearinghouse on Reading and Communication 
Skills (ERJC/RCS) of a series of booklets designed to meet concrete 
^durational needs. Each booklet provides teachers with a rortevypf the 
best afticational theory and research on a limited topic fpllowed by 
descriptions of classroom activities that will assist teachers* in putting 
thatotheory infb practice. 

The idea is not unique. Several educational journals and many com- 
mercial textbooks offer similar aids. The ERIC/RCS' booklets are, 
however, noteworthy in their sharp focus on educational needs and 
their p'airing of sound academic theory with tested classroom practice. 
And Xhey have bben developed in response to the increasing number of 
requests from teachers to provide this kind of service. 

'Topics fpr these booklets are recommended^ by .the" ERIC/RCS 
National Advisory Board. Suggestions foMopic/are welcomed by the 
Board an<j;shouId be directed to the Clearinghouse. • 

Bernard O'Donnell 

O \ ' ' 'Director, ERIC/RCS 

il£ - 

bob <*& ' , 



1 Theory and^lesearch ' 

t4o act of communication is complete until it has been evaluated and 
criticized by others. No public figure escapes the judgments of others. 
After a nationally broadcasted speech, media personnel write and 
speak their judgments, audiences react from positively to negatively, 
, and opponents look for weaknesses. Classroom communication is the 
$ame. Students will agree or disagree with the topic, react to the 
language used, and form judgments about the delivery. This prpcess 
cannot be stopped. People will always evaluate communication in some 
way; it is an inevitable part of the process. Further, by evaluating the 
performance of others, students learn to identify effective and nonef- 
fective behaviors in the speaking situation. < ; 

One problem faced by anyone wishing to evaluate communication is 
v to % select and apply the appropriate criteria. Once the criteria have been 
established, the next task is to systematize the judgments. Obviously, 
different individuals will disagree as to what criteria shbuld be used, 
and what system is best for applying 'them. These systemati/ed judg- 
ments must thenJ>e communi&ted to the speaker in the form, of feedback. 

Of the several Forms of feedback that can be used, the problSrrris-to 
,nftake th£ feedback systematic- A major solution to this problem is the 
use of-rating, scales as a form of feedback: ^ ratingscale is formally 
defined as 44 /. . a psychological measuring instrument that requires 
the rater to assign the rated object to categories .or continua4hat bave^ 
numerals assigned to. them." (Kerlinger,* 1973). In the case of speech 
evaluation, a rater evaluates a speaker using numbers to represent a 
judgnwnJLiw.a number of categories or traits. The rating scale method 
7 of feedbtfck'-is_being emphasized for this booklet since it gives* the 

♦ teacher an objective measure across .all students. Rating scales are 
widely used to evaluate speeches and other communicative perfor- 
mances because they provide (If a standard set of criteria toT)e applied 

• to all speeches, and (2) a systematic way of applying the criteria. 

* However, can a rater represent feelings about a performance ^>y 
I usin^ a number? The* rationale for this process is essential to under- 
standing the act of evaluating. Perhaps the question should bethought 
of in terms of matching ont thing to another. As the psychpm.etrician- 

* S.S. Stevens (1968), asserts; 44 If you would Anderstand the essence of a 
given measuring procedure, you should ask what was matched to 
.what." How then does a\atin£ scale" achieve matching the perfor- 
mance, a juctenient of that act, and numerals? 

TKetfirst step is to provide a set of instructions by which the matching 
may^fre accomplished. These rules 'are present \n the descriptive 
O tatements in, each category of the rating scale. 
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The second step is to provide a linear scale so that the statements can 
be seen as falling along a continuum. The various points on the line 
should be arranged so that each point represents more^4ess_of_a 
"good" judgment. 

The assignment of numbers to these points completes the process. 
Thus, it can be reasoned that a carefully developed rating scale 
represents, in quantifiable form, what the rater saw in the com- 
municative act. These numbers, in^urn, become the basis for a grade 
on the performance. These grades now have more 7 empirical basis for 
the student to interpret. For instance, the difference between a 95 and< 
an 85 is easier to understand than the difference between an A and a 
B because of the relationship to parts of the scale. 

'A Model of the Evaluation Process 

The process of evaluation has' as its basis the act of judgment, and 
human judgm^t is always fallible. As a result trie process of 
evaluating speech communication behaviors has certain errors 
associated with it. In order to predict and .control these errors, a theory 
of speech evaluation and rating errors has been developed by the 
authors. Present theories* do not accouht for the role of errors or the 
place of evaluation in the prodess af communication. The following 
diagram of a model of this theory illusfrates the major concepts of this 
theory of speech evaluation. 
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In this model a speaker creates a message and uses a channel(s) to 
communicate to a receiver (rater). The receiver than enters into a 
process of evaluation which is affected by two types of possible errors, 
the scale Being used and judgmem of the rater. This whole process is 
influenced by the environment (classroom atmosphere, for example), • 
and demand characteristics 1 operating at the time. A demand chardv 
teristic occurs whan a rater picks up even the slightest clue about what 
the teacher expects in the situation. For example, the rater ma> be 
rating a student whom the teacher picked as a model and will tr> to 
give the speaker the v benefit of the doubt. A type of Pygmalion effect 
occurs that warps the accjurate feedback desired. 
* The critical concept in the model is the feedback based on the 

evaluation. The whole idea, behind evaluation is to give xhe speaker 
sgme help in preparing future assignment?. This feedback given bv the 
receiver* may be in written form, as in a rating scale, or in oral form or 
a combination of these. Evaluation-based feedback is the essence of the 
process. « , * 

As the teacher provides eyaluafion-based feedback, the other mem 
bers of the class either listen to the comments or are given a chance to 
read them. These comments then become part of the environment and 
future demand characteristics. As such, the evaluation-based feedback 
is one of the mQst powerful teaching strategies that a teacher can use. 
Your comments will not only affect the individual to whom you are 
directip^ them, but they will also affect other students who hear or sbe 
them. The teacher who is aware of this aspect of the process can ac- 
complish more teaching during critique sessions than, during actual 
* lessons. 

Later 'we will discuss practical techniques for implementing this 
model. The, important aspect here is that the rating becomes feedback 
which becomes part c)f the environment and the demand characteristics 
for future performances. w 

Rating' Errors in the Evaluation Process 

This process of evaluation is always subject to rating error. The major 
errors that have been identified as having an impact on the evaluation 
process are the leniency error, the halo error, the trait error, the error 
of central tendency^ the proximity error, and the logical error. 
The rater might be either too easy (positive leniency error) or too 
I hard (negative leniency error) on all speakers. Such a- teacher may bcva 
, % "soft nose** and give consistently high ratipg-to everyone in class, *6r a 
"hSTrd nose** and give consistently low ratings to eyeryojie. On the 
* other hand, a rater might be too easy {positive halo error) t>r too hard 
(negative halo error) on a specific speaker. A itudent who is the 
© Teacher's pet** will receive high ratings despite an occasional 
El\|O sdiocre performance. Likewise, a student. may receive low tatings 

-a. 
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simply because of a personality conflict with the teacher. Thus, the 
. teacher needs to reflect on the evaluation procedures for the whole 
\lass along with those for specific individuals, to avoid the traps of the 
leniency error or the halo error. 

The trait error is the tendency of the rater to be either too easy or 
too- hard on a given trait (category) of the rating scale. This error oc- 
curs across all speakers. For example, a teacher njay be especially easy 
I on organization and give all speakers who have an introduction, body, 
and conclusion high ratings on organization. On the other hand, the 
teacher may be especially hard to please when it comes to delivery and 
will give low ratings on delivery. By examining the emphasis given f 
through evaluation-based feedback, the teacher can discover the 
relationship between what is taught and what is critiqued. If" the 
teacher emphasizes organization, but criticizes mostly delivery, the 
students will respond to Jhe message of the critiques. 

Many raters have a- tendency to group scores toward the middle of 
the scale values, thus causing an error of central tendency. For exam- 
ple, our research ^.has shown that on a teiKpoiijt scale, most of the ' 
scores tend to group around seven. In other words, raters tend to avoid 
making extreme judgments at either end of the scale. Not many tens 
are given and*not many ones are given. 

The proximity error is the tendency of the rater to give two traits on 
a rating scale the same rating, simply because they are next to one 
another on the^age. For instance, if "language" and "material" are, 
located next to one another on the feedback form, they might be rated 
similarly because of a certain inertia that develops in putting down the 
numbers on the scale. 

The logical error is the tendency of the rater to rate traits *alike 
because they are legally related even though they may be separated 
from one another on the scale. A rater might evaluate "delivery" and 
'"voice" similarly because they are both matters of physical* presen- 
tation. x 

Part 2 and Part 3"x5f this booklet give sogie practical suggestions for 
„ controlling these errors nonstatistically. 

' Research' in Evaluation and Rating in the Classroom 

This section is a distillation of useful information from the published 
research studies on speech evaluation in terms of practical use in the 
classroom, dealing first with speech evaluationjn general, and second N 
witfi rating errors. 

i 

Speech Evaluation 

How sufficient time between speeches for everyone to complete their 
valuations. (Baker, Kibler, and Hunter, 1968). The study showed that 
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students who were rushed comprehended less from the speeches they 
heard. Als6, students who were rushed in their evaiuationr-tendecHo be - 
too easy in evaluations, so the speaker did not gain from the desired 
'feedback. * _ _ \, 

Train the raters in the use of the scale before they use it the first \ 
time. (Bowers, 1964). A practice speech could be used on videotape, 
followed by a discussion of how to rate the various traits. This 
technique reduced the amount of variation^^among the raters, as the 
raters tended to rate more like the teacher affer a practice series. Such 
practice reinforces the teaching function oFidentifying what is impor- 
tant by evaluation. / 

Define the meaning of each number to be assigned. (Guilford, 1954). ♦ 
If the raters understand what is meant by a 3 or a 7, they will be more; 
likely to give feedback 'accurately for scale positions. The use of a con- 
tinuum with identifiable differences, especially if some can be demon- * 
strated, helps students understand hcyw the numbers relate to speaking 
behaviors. ' 
- There is nvreasvn to include tr trait tike-Hgeneral effectiveness " on a 
rating scale. (Clevenger, 1962). This global trait contains the im- 
pressions in the other traits and adds no new information. Including it 
on a feedback sh$$t is redundant*, since the grade becomes the sum- 
mation of parts jvhich indicates the holistic judgment. 

Inform the raters'about the "following effect." (Bock, Powell, Kit- 
cjiens, and flavin, 1976). The following effect refers to the situation 
when an outstanding speech has just been finished and no one in the 
class wants to "follow the act." Everyone assumes that their, ratings 
will suffer by comparison, but research has shown that the opposite 
occurs. The .speech following an outstanding speech is rated higher 
because of its position, particularly if the speaker is female. Therefore, 
teachers and students alike should be aware of.this phenomenon. • 

Students perceive specific comments to be more helpful than general 
comments. (Young, 1974). For example, "You need to develop more 
eye contact with the audience" was perceived to be more helpful than 
"You need to work on your delivery." In other words, the teacher 
* should break down comments to the most specific level. To say "The - 

v content of the speech was not adequately developed" would not be 
, ^ perceived 2s helpful to a student. However, "You need tcvsupport your 
first argument \vith more examples and statistics" would be perceived 
to be helpful. 

An impersonal approach in criticism is generally preferred by students f 
rSther than a personal approach. (Young, 1974) . v Impersonal comments % 
3re those that deal with the class as a whole rather than an individual 
student. Impersonal comments can contain more objective .language, 
q --'hereas personal comments may include the teacher's affective re-, 

FRIO onses t( ? the stu ^ ent - For exam P le » <<The maln Points of today's j ( 
Haa^Sfflj>eeches were well organized" would be perceived to be helpful. On 
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the other hand, "f really liked.your use of language in speech" would not 
be perceived as helpful. Apparently it 'is more helpful to students for the 

• teacher to be more cognitive in comments rather than affective. 

Students' perceive both positive and negative comments as helpful. 
(Book and Simmons, 1980). Raters have a general tendency to focus on 
the positive in speech evaluation Two recent studies suggest that\udents 
perceive hath as helpful. Students gain by knowing which choices are. 
working well and which behaviors seem to interfere. Try to achieve a" 
balance of the two in speech evaluation. 

Inform the students about the vanous rating errors. (Guilford, 1954), 
^ "One of the ways to control these errors is Jo discuss them with the raters, 
and to-' caution thern against committing the errors. Being forewarned is 
being forearmed in this case. * A • 

There are four general types of raters. (Powell and Bock', 1980). The 
first tvpe is able to effectively rate both delivery and content. However, 
these two factors are the only ones that are important to them. Another 
tvpe is onl> interested in topic presentation and *pcalics. They do not use 
content factors at all. A third type uses, mostly general impressions and » 
verbal adaptation to make judgments. The fourth type tfiftds to judge 
onlv tactical matters — for example, analysis and language would be a 
major focus for this type. Knowing these types -should help the teacher 
rinderrfariti the individual differences in the raters. As well, teachers 
should identify their own style to ensure that what is being taught .is 
evaluated/ 

' ** 

Rating Errors - 

* The easier a person is persuaded, the- easier they will be in terms gf 
Zewieflcj\£OH£^(^^ the harder a person is^o per- 
suade the greater the tendency toH&TTia^ in terms of 
ratings. * u * 

Raters will be easier on all speakers tf )they know thejj^gj^sjmU^ee^ 
the results, (Builford, 1 954)7 Ttrerefbrcrnf 1 5fffig enT7a t in gs-are used as a 
method of feedback for the speaker, some method of ensuring that the 
speak* will be unable to identify the individual raters should be used. 
Some methods for doing this are (i) use student ID numbers instead of 
— ramesTT^T^Tg'n special numbers to the raters for the purpose, of (3) cut 
off the rater's name or number before returning the ratings to the 

speaker. j > 

A person who has a high need for order tends 'to make positive-trait-^ 
errors on organization. (Bock and Munxo, 1979).JSu£h a person tends to 
ofganize even the most disorganized "sjiSchTntb a pkttern that is under- 
standable td him or her. Therefore, everything looks organized fo such 
people, and fhey rate organization high. The unorganized person, • 
however, cannot see organization in anything and therefore rates, even 
good organization consistently low. ' t 

There seems to be a "same sex" effect on halo errors (Bock and Bock? — 
197 7 ) Males .tend to make more positive -hal o erro rs on male speakers, 
and females tend to make positive halojejpors on female speakers. It does 
O ;em to be a case oT rating the opposite sex negatively, but a case of 
/aluating members of the same sex w _ w i j 




Some studies suggest that women are more positively lenient than 
men, but more recent research suggests that this is the case only in the 
presence of a female authority figure. (Bock and Bock, 1977). This 
problem may mean that female teachers will want to alert female raters 
to such a possibility. 

Raters tend to make more positive halo errors on speakers whom 
they know qnd like. (Henrikson, 1940; Barker, 1969). Also, studies 
have shown that speakers who have high 'academic regard and high- 
social regard also tend to receive positive halo errors. The \eacher ma> 
want to check periodically to make sure that students are not rating 
members of their social group too high or rating those* not in their 
group too low. , „ 

On the traii of bodily action, males )end to' make more positive trait 
errors than do women. (Bock and Bock, 1977). Men apparently do not 
scrutinize delivery as critically as do women. A teacher may want to 
caution males against this particular tendency/ Or a male teacher may 
wish to take this into account in his own ratings. 

v More trait errors are made on the trait of bodily action in a videotape 
situation than w a Jive TV or a live, face-to-face situation. (Bock, et 
al., 1976). This finding is especially important to teachers whd use 
videotape replay as a means of criticizing and grading speeches. Ap^ 
parently the ability to go back over the speech several times results in a 
tendency to find more faults in bodily action than in content traits. 

Raters tend to commit more negative errors on language 'in a speech 
containing profanity than in >a speech that does not contlfin profanity. 
(Bock and Butlec, 1979). Several versions of the same speech without 
profanity and using either sexual, exretory, religious, or a^ com- 
bination were studied. Wacn students that the/ratings of language will 
suffer when using profanity. / 

2 Practice 

h K . ; - 

With the theoretical basis for rating and speech evaluation in mir^d, 
several teaching issues need to be examined that emerge when actually 
rating speeches in the classtftom setting. 

When to Evaluate Speaking Performances 



On£ of these issues is when actually to do the evaluating. One option is 
p after each speech has been presented. This provides the student with 
immediate feedback ,abQut the presentation. jjhis period has advantages 
from the student's veiwpoint. Examples are easily remembered because 
they have just occurred. If student oral evaluations are being used, ini- 
Q nediate evaluation provides them the opportunityto be more specific 
£ I^IC ^ an *tf ^ked to comment after several presentations have been made. 
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Some disadvantages of immediate evaluation exist from the student 
point of view. This method creates the "first person" syndrome. Few 
students want to go first because they prefer to wait until the teacher 
hab made some evaluator> comments about other speeches and perhaps 
those comments could be used to make Xheir own speech better. 
Students who "go first" often want to receive extra credit because they 
made their presentations without Benefit of any previous evaluations. 

Sometimes the student who has just made the presentation is so glad 
to get it over with/ that little attention is paid to the evaluation. 
Speakers are so busy getting the sweat from the brow and the butter- 
flies quiet in the stomach that the immediate evaluation period cohies 
and -goes with little drx no notiorr or involvement on the part of the 
speaker. ^ 

Difficulties ocfur for the instructor using the method of immediate 
evaluation. During the presentation, the teacher has to concentrate on 
the comments to be matfe during the evaluation stage, rather than con- 
centrating totally on the speech. Also, from the feacher's perspective, 
criticism after each presentation is a time-consuming means of 
evaluation. With larger enrollments in speech communication classes, 
few teachers can afford the luxury of taking five to seven minutes or 
longer after each speech for evaluation. -No matter how much impor- 
tance is placed on the evaluation process by the instructor, practicality 
must be cdnsidered. 

Another possible time for speech evaluation might be at the end of 
the class period. From the student point of view, there is safety in 
numbers. Comments would most likely be made about groups of per- 
sons rather than a single person. (See the comments' on impersonal 
* feedback, in Part 1.) Often students are better prepared to listen to 
comments about their speeches at the end of the period. In addition, 
students can ask questions about individual difficulties they are having 
without associating themselves with the problem. Student speakers or 
listeners might, for example, refer to an organization ^ problem in o ne 
of the presentations and obtain help from the instructor on how to 
handle the situation without having,to admit to experiencing the same 
problem personally* 

Evaluating the speeches* at the end of the class period enables 
teachers to use student speeches as concepts being taught in the unit. 
Evaluations could be grouped around larger topics^rfor example, in- 
troductions, conclusions, evidence, organisation, delivery. These 
» generalizations avoid the possibility of having to say much the same 
thing "about a majority of speeches that occur in the day. In addition, 
students will still* remember the examples that were used because they 
have just occurred. Teachers need not refer to a specific student in the 
evaluations. 

Unfortunately, evaluating presentations at the eijd'of the period af- 
gj^j^ords less Opportunity to individualize the comments. Some comments 
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caij be made without mentioning any student speakers by name. Yet, 
. this lack of personalization might cause both the student speaker and 
the listener to wonder just whose speech was being referred to and 
why. 4 The instructor should recognize that when evaluative comments 
become too generalized, little useful information is gained by the 
students. fo 

This evaluation method also has an advantage from the teacher's 
standpoint in that it can be planned for th* time remaining after the 
speeches have been given. While this strategy may save some valuable 
time, it seems unwise tQ "work in" evaluations; plan them. Because 
courses stress the process nature of communication, evaluation and 
feedback should be given as much planning and attention as the 
presentation of ideas. * t 

Enough time should be allowed for evaluation. If the instructed is 
rushed, the evaluation session will probably receive a ver>) superficial 
treatment. If enough time is used for evaluation, the students realize 
that it is really a session where they can get help to improve their per- 
formances. If it is rushed, students will think that evaluation is not a 
very important part of th6\process and will probably treat the session 
v^ith little attention, concentration, and effort. 

Presenting the evaluation at the end of the class period, then, 
provides the students with some anonymity in both the sending and 
receiving of comments. Teachers can avoid repetition and make better 
use of the time, although the impression that evaluation is npt 
necessarily important sttould be avoided. * ^ 

Another popular time for the presentation of evaluation comment? 
about speeches is at the end of the speaking round. From the student 
perspective there is less chance of being singled out for /O&ticism. 
Grouped comments provide safety in numbers, if individuals are afraid 
of having 'comments made about their own presentations. One disad- 
vantage from the student's viewpoint is that long-term feedback is not 
as effective or valuable in terms of improving performance as is im- 
mediate feedback. It 'is possible that even the students, have forgotten 
some of the ppints or actions of their own presentations. 

This evaluation time enables the -teacher to make generalizations 
about the entire class. Repetition is avoided and comments generally 
take a 'less threatening form when made in terms of a group rather than 
an individual. Reserving comments until the end of the speaking round 
might make it possible to take an entire class pericpi for evaluation. 
This amount of time would enable the teacher to concentrate on the 
receiver-feedback aspect of the communication*, .as well as the sender. 
If the comments are not individualized, however, confusion can easily 
result as to just which speaker should work-on which problem. Waiting 
until the end of the speaking round^for evaluations also means that 
Q ct udents will not remember the comments nearly as well as if they were 
^ j^-iven nearer thef time the speech is actually delivered. Particularly when 
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classes;are large and speaking assignments are long, two or two and a 
half weeks might 'elapse .befw<£n the. example and- the instructor's 
comments about it. The teacher might even .forget some important idea 

. that at the time of its presentation seamed pregnant with teaching and 
learning possibilities: 
Evaluation may also be given to the speaker during the presentqtion 
k itself In general, this is not an appropriate time for evaluation, f^r a 
student who .juffers from communication apprehension, , however, a 
smile or an approving nod is often enough positive nonverbal feedback 
to provide the desired encouragement to continue. Positive evaluation 
asJcmonrfrated-lhtough attention^and-eye contact- is also-useful to 
students, particularly during the first assignment. 

Only in extreme cases should' negati¥e feedback or evaluation be 
£iven during the presentation, This form should be used only as a last 
resort for a student who persists in making the same mistake over and ' 
over again. For example, a student once insisted on concluding the 
speech, while Walking away from the podium. Comments were made 
about this by teachers and student* aliRe, but to no avail. The student 
insisted that this was a mistaken observation oh the part of the audience, 
and the teacher was merely tnakmg up things in order to justifya tower 
grade. Finally, in the last speech of the ternvthe teacher stopped the 
student in* the middle of the conclusion, only for the student to find 
that the podium was far away and the desk was amazingly close. This 
exarfiple was a particularly, difficult case and warranted an atypical and 
drastic measure. The instructor should be especially careful in using 
the'speech as a time for evaluation. Some speakers are able to handle 
interruptions better than others. Some students can take the, criticism, 

.make the necessary changes, go qn with the presentation, and benefit 
, from the, experience. Such people are rare, however, and a good rule of 

^thumb is not to interrupt speakers during the presentation. ^ 

How to Evaluate Speaking Performances * 

Another question that confronts the teacher of speech communication 
is how to give students comments and criticisms. The two most oBvious . 
places for oral and written comments are in class and in a private con- 
ference. > 

For evaluation and criticism to be useful when they are given in the 
dassroorft, the instructor has to build an atmosphere or classroom . 

^ climate in which the student understands that criticism is a useful part 
of the learning experience. This kind of environment is partly 
developed by the manner in which the criticism and evaluation are 
given. If the instructor is sympathetic, friendly, and enthusiastic iir 
doling with student's presentations, thaf contagious attitude will be 
apparen^to the class members. When the teacher explains the process 

O fcomftllication to the students, if emphasis is placed on both the sen- 

■jg - ; ■ 15 ; : _ 
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der and the receiver, students will realize that evaluation is a necessary 
part of the process of improving the skills of speaking. 

In addition, if the teacher stresses that everyone should be ,trying io 
•upgrade his or her speakirjg performance, then perhaps the idea of " 
working together for mutuaf learning can be advanced. If the students 
learn to understand that everyone has both strengths and weaknesses as 
a speaker, they will realize that no one is alone in the need for helpful 
criticism. Sometimes it is an effective technique for the teacher to give' 
a speech and have the students begin learning the process of evaluation 
by criticizing the teacher. It is also useful for the entire class to hear a 
sp&ker outside the classroom, and make this experience the basis of a 
class evaluation. By using this technique, students not only realize that 
there is always "room for improvement," but they also learn through 
example about how to react to positive and negative comments. If 
students can learn that evaluations are not meant to be exposures of 
personal weaknesses, but ratiner suggestions about areas where im- 
provement is warranted, beneficial results will most likely occur. # 
Sometimes it is useful to equate speech evaluations with teaching a very 
young child .the social graces. Only after repeated CQfnrhents and 
evaluationsHoes a child learn that it is incorrect to "make^a scene" in 
public. As students learn new skills and speech behaviors, these in turn 1 
require further evaluation and continued work by the student and the 
teacher. 

Evaluations should be as individualized as possible. Students are in- 
dividuals and respond to different things. It is particularly important 
that tjie same comments are not repeated for every student. Even if 
several students have the same problem, it is a good idea to try to make 
sure that each speaker receives some comments that ^re specifically 
directed at personal performance and personal improvement. 

Under no circumstances should students be ridiculed. Humor and 
Sarcasm should be jjsed sparingly and only in situations where the 
teacher is positive that the student will understand the intent of the 
humor. The xlass should not pome to view the evaluation session as a 
time^r tasteless humor or rude commehts. Sometimes a fuhny thing 
may well happen in the course of a speaking assignment,. This event 
may be commented on and even laughed about again, but individuals 
should hot be hurt or downgraded in th£ process. • ♦ " 

If students are encouraged to set individual goals* for each speaking 
assignment if each class member can become aware of 'individual 
progress and improvement. For example, a student may state in class 
that he o^she^sgping to concentrate on organization for the next 
assigrtfnent. As the improvement is shown, students see that success is 
possible^ and the class can share in the progress of persons from one 
point to another. If progress is not made, the entire class can benefit 
r rom a teacher's efforts to help the student. Also, several members of 
he class who are experiencing the same problem may be encouraged to 
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worJc together and help 'each other. 

If comments are made in class, it is perhaps a good idea to use the 
first assifcn^d speech as a diagnostic instrument. Succeeding perfor- 
mances can be judged in terms^of improvement from the first effort* In 
particular, if students are given comments about a speech that is either 
not going to count toward their grade, or is not worth as many points 
as subsequent speeches, the oral comments in class give them a real 
opportunity to have a "free" speech. They gain the speaking experience, 
have the benefit of the instructor's and the^ class's comments, and 
become aware of areas that should be improved for the next presen- 
tation— yet they are not penalized or graded dowirfor the presentation. 
This kind of exercise helps to create the atmosphere wherein construc- 
tive criticism can really hejp the individual student, as well as the whole 
class, to improve speaking ability. 

When giving evaluations in the classroom, the instructor should 
develop a pattern or formula around which most criticism is constructed. 
A\nodel not only helps to ensure equal treatment for persons receiving 
the evaluation, but it also provides the students with a framework for 
criticism that can be carried with them /or use outside the classroom. 
Teacners should develop methods .of criticism and evaluation that fit 
- the situation. ; " - 

Throe commonly used approaches exist for the giving of criticism: 
(1) to c<\mnfent only on the effective assets of thjff performance^) to 
comment only on the ineffective behaviors, and (3) to sandwich the 
ineffective between the effective behavior*. 

The first two of these approaches lend to give the student an 
exaggerated view of the, performance. The student leaves the evaluation 
session with the id§a ttrat either nothing was wrong with the speech or 
that nothing was right about it. ^Probably the best- meth£#* is to 
acquaint the student with both strengths and weaknesses, jiie teacher 
should start the evaluation with a positive item, then comment on some 
areas needing improvement, and conclude the evaluation with a 
positive note. In this way, students find out what they did well, in ad- 
dition to what they did not do so well. They are then left with the idea 
that the performance had some good moments and some weak ones. 

Do not shy away from making comments abput weaknesses ill the 
speech, because these comments help the student improve in the future. 
Make sure that the comments are given in a clear and objective man- 
ner. This approach helps the student avoid the "picked on" feeling, 
-and provides something concrete to work on fof the next assignment. 

In addition to the preceding method, it is a good idea to discuss 
specific causes of problems that students are facing. For example, if 
, the class is having difficulty in following a line of reasoning, 
organization might well be the problem. A student might lack 
£ iibility with the audience, and material or delivery might be the 
£J^J(^se. As the teacher discovers and ^e^pnst rates multiple reasons? for 



problems that are'occurring, the students discover the interrelationships 
of various aspects of the speaking situation. 

It is also ^important that the instructor discuss various ways of im- 
proving or alleviating the difficulties. If -a student is faced with an 
unusually large number .of areas where improvement is necessary, the 
instructor might ask the student to work on one important item for the 
next assignment. To help with this strategy, the teacher might keep a 
file card on each student. With each speech, the teacher selects one item 
for the student to focus on for the next speech. Then some comments 
can be specifically directed to that item when the next /£eech is given. 
- This ~ method * gives the- -student a -sense of^accoinplishttienT an 
progress. The student should not be left with the feeling that so many 
things need improvement that it is hard ttr know where to start, or 
wondering whether it is worth the effort to startrat all. No matter what 
kind of criticism! is used, it should have a focus 'tfiat is obvious to the 
student. \ 

Teachers should try to a^void only prescriptions in the j giving of 
criticism. Discussing issues and asking questions is probably more help- 
ful than only giving specific remedies to solve the problems. 

Students need to understand how different audiences, situations, and 
subjects influence the appropriateness of the speaking behavior. 

Sometimes classroom or public criticism is inappropriate fo'r one 
reason or another and the, student should be invited in for a private 
conference. The instructor should be careful that a private conference 
does not publicly single out a student who is having problems. This 
could cause serious problems for the student. Several students could be 
asked to have conferences; ideally, every student should have one. 

The conference provides an opportunity for the teacher to talk directly 
to the student about positive and negative points regarding the in- . 
dividual's speaking performance. This gives the student the idea that 
the tocher is interested in each student's progress. Particularly if class- 
time evaluations are. mostly generalized for a group of students, the 
private conference allows time for the teacher to discuss problems, not 
just point out their existence. 

Private conferences also allow the teacher to build rapport with 
students that is not often possible in the classroom. Particularly if the 
student is having difficulty with the speech class, the private conference 
can point out to a student that the teacher is really interested in helping 
him or her as an individual with unique ptablems. Teachers seem more' 
human in this situation and it is easier for the student to speak to 
someone who "cares." \ 

Individualized attention makes student feel special, thus building 
their confidence. Knowing that the teacher is on their side also helj?' 
ease the tensions that might be associated, with later speaking assign- 
nents. If students know where the teacher stands on certain issues 
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about the speaking performance, £ommunication apprehension is less 
likely to become a serious problem. 

Students are better able to discuss their problems with the instructor 
in a private conference r ather t han t he classroom. Here, students with 
physical, emotional, or other problems are more likely to reveal them, 
enabling the teacher to allow for individual differences in the 
classroom It might be well to try to identify students with extreme ap- 
prehension and talk to them, but care should be taken to prevent 
students from becoming psychologically dependent on the teacher. 

It is a good idea toehold private conferences as early in the term as 
possible so students With unusual problems will not be hurt or 
discouraged by classroom evaluation. Students with psychological dif- 
ficulties probably should not be evaluated in front of the other students. 
If they are evaluated publicly, the teacher should try to talce the in-, 
dividual problem into account. 

Of course, private conferences are a very time-consuming jnethod of 
evaluation. In these times of large classes, a teacher often does not 
have enough hours in the day to allow a private conference with every 
student. If instructors are .teaching more than one speech com- 
munication class the task becomes even more diffipulr. To solve this 
problem, a modification of the private conference could be made. 

The teacher could carefully select students to come to the office in 
groups. This could also be done in tlass, while other students are 
working on different things. The students in the groups should be as 
similar as possible and hopefully have similar problems. The students 
will still get some individual treatment, yet several students can get that 
treatment at the same time. Then, individual conferences could be held 
with the students who have unusual problems, or who request a con- 
ference. Private conferences, however, are very useful in helping the^ 
student and in promoting the concept that criticism and evaluation are 
"important and useful. 



Modes of Evaluation 

Teachers often" wonder whether evaluations should be written, oral, or 
a combination of both. * 4 

Written evaluations are probably the most common form "used by 
teachers at all levels of education^ The written comments are tangible 
evidence of the teacher's impressions of the presentation. Students have 
something to keep and to refer to when preparing future presentations. 
Written comments also provide the student with a commentary on the 
progress that is being made from one presentation to another. The 
student is abo aware of the criteria to be used from one assignment to 
another and. thlr knowledge not only helps the studentao improve 
U iking skills, but also to understand the basis' of the evaluation. In 
ICition, if the student comes in for a private conference after the 
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presentation, the written comments can aid the teacher in directing the 
student's energies toward areas needing improvement. Particularly 
when a teacher is faced wfth evaluating a large number of students per 
assignment, it is embarassing for teacher and student alike if the in- 
structor does not remember the speech In question. If students are en- 
couraged to bring in the written comments, this problem can be 
avoided. % N 

Written comments save the teacher time. More speeches can be heard, 
because less time need* to be devoted to oral criticisms. In addition, 
the teacher is likely to be more preciso^and consistent in the remarks 
that are made on the evaluation sheet. With the knowledge that the 
student may present the evaluation for future help, the teacher tends to 
pay more attention to what comments are made, and precisely in what 
areas the student excelled or needed improvement. This preciseness is" 
of benefit to both the instructor and the student involved. 

When using a rating blank, the teacher' must make comments 
systematically on all aspects of the speaking performance. If oral, 
comments are used alone, some aspects of each speech may be 
overlooked in the discussion. But the instructor finds it more difficult 
to leave blank spaces on a rating form, or fail to evaluate one aspect of 
the assignment— style, for instance, so the student tends to receive a 
more complete evaluation of the presentation rather than comments 
about certain aspects of the presentation. \ 

Written comments may appear on many different forms, inclvdinfc a 
rating scale, a critique form, or a piece of blank paper. Whereas oral 
v comments provide immediacy and focus, written comments ' give 
argument and reflection. Many teachers construct their own rating 
forms to meet the specific needs of their students and their assign- 
ments. Sample rating blanks appear on pages of .this booklet. See 
-page for instructions and suggestions for constructing a ratirfg scale 

• and feedback forms with their scales and items. 

Oral comments and evaluations have the advantage of immediacy, as 
mentioned earlier. They ^require comments to be generally made the 
day the presentation is made, before the student forgets, what he or she 
has done. 

Oral comments should describe what was actually done during the 
presentation, the critique should be specific and discuss concrete 
examples and what should be done to improve the speech. The 
evaluation should also discuss behaviors that were done well, and why 

• they were especially effective. Particularly in an oral critique, effective 
* aspects of the speech should generally be discussed first. 

The teacher's oral comments should convey sincere interest in the 
improvement of the speaking performance. The, teacher should show 
sympathy and concern for student! who are struggling to handle ar 
O unusually difficult problem. Perhaps it might be useful to suggest that 
£ I^JC a number of students are facing similar problems. If the students "n the 
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class get the impression that oral comments are merely a means for the 
teacher to "pick on" someone, then the valine of the criticism is 
severely limited. The teacher's attitude is jnost important in making the 

evaluation session useful to the student. - - — — — 

Teachers should develop a language of evaluation that is precise and 
concise. Students should be able to. tell just what the evaluator is 
saying. Teachers should always be awar/ of theVeedback that student 
speakers are sending during the evaluation period. It is useless to go 
through oral or written criticisms if the students are unable to under- 
stand what is being said or what suggestion is being made. If students 
see the teacher_as a model, they^Oo can develop «good evaluation 
habits. To develop consistency of meaning the teacher should use the 
terms on k the rating scale in order ta reinforce the concepts. 
. It does not seem useful, however, to pamper a student. Each speaker 
and individual should learn to take criticism— to recognize limitations 
and to strive toward improving them. If the teacher is impartial in the 
evaluations, and if the least embarrassing way is, found to give com- 
ments, student $an learn ' the valuable lesson of how to handle 
criticism. Perhaps the attention of the entire class, can be focused on 
ways to improve or suggestions for an individual speaker. It. may also 
prpve helpful to contrast methods of variouslpeakers in approaching e 
certain problem. Then students can learn by seeing others try different 
techniques to approach a particular speech problem. 

From the educational perspective, an unusually effective method of 
giving evaluations is" to combine the written and the oral comments. 
Organizational communication research ha^Ufhd that the'use of two 
channels of communication is better than just one. This principle is 
particularly accurate in providing students with feedback about the 
speaking assignments. Oral comments made in class and reinforced by 
a written evaluation help to emphasize to the students the important 
principles to be remembered. If time prohibits oral comments on each 
speech, the student could be handed a written evaluation at the end of 
the performance, and the teacher could summarize the important points 
for the entire class in an oral session following the day's speeches or 
the spea king roun d. In either case, the student hears the speech 
discussejkBy thet^fepher and the class, and in addition, the student Has 
tangible evidence that can be carried away, read later, referred to for 
improvement, and kept as a record of the progress being made. 

Videotape provides another useful method for speech evaluation. 
The teacher can direct full attention to the speech without having to 
stop apd write comments on a rating sheet. This method enables the 
teacher to give the student nonverbal, positive feedback during the 
presentation, rathet than haye the student look at the top of the 
teacher's head throughout the speech. In addition, the*teacher can take 
me, tijne to think about the speech before evaluating it. The tape can 
ER^C ^ewcA several times so the teacher can make sure that judgment of 

L_ 21 ' v 
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* the speech is fair and not based on the emotion of the moment. This 
v method of criticism also saves time because parts of the speeches can 

be replayed for £lass comments. One or two examples can effectively 
make a point without replaying ail the speeches, which saves con- 
siderable time. The examples will remain in the minds of the students 
because they have just seen a replay of the speech. (See Part 1 for 
several cautions in evaluating delivery via videotape.) 

Perhaps the biggest advantage of. videotape is that the teacher and 
the student can go over the speech in private at some later date. The 
teacher can° stop the tape and replay a .part of>*he speech for the 
student to emphasize a particular bfehavior. The student t can see 
and/or hear exactly what the teacher was talking about when the com- 
ments were made at the time of presentation. One useful variation of 
videotape is to give the student a written evaluation of the ppeech, take 
a day in class to replay some speeches that point up common problems 
of the class, and then, if the student wishes additipnal help, make the 
. tape available for viewing individually br in the teacher's presence. 
• This method seems to combine the most usefuL aspects of both written 
and oral comments. 9 \ 

Unless the teacher is'fortunate enough to teach in a media center or 
a classroom where the equipment is built into the facilities, it is a real 
problem to transport the equipment- from place to place. It takes 
muscle, time, and patience. Often, setting up the equipment uses 
valuable speaking tijne. If the equipment is available, perhaps .the, 
teacher could arrange for the taping of one or two speaking assignments, 
rather than those of the entire class. This provides only a few students 
with ,an opportunity to view themselves, but it does save time on" a 
majority of Ihe assignments. 

Unfortunately, if the student views the speech individually, the entire 
class does not benefit from the learning function that other presen- 
tations provide. This might be avoided to taking a day in class and 
devoting it to the playing of speeches and ttm giving of class comments. 

Experience with videotape recordings in the speech classroom shows 
that mo§t students are not unduly apprehensive about their use. 
Research studies have investigated many aspects of the effectiveness of 
the videotape in various classroom applications. The data in one such 
e study implied that the presence of a videotape recorder in a cjassroom 
speaking situation created no negative aspects of speaker response, 
(Bush, Bittner, Brooks, 1972), nor did it cause additional anxiety in 1 
student speakers. It seems that if a person is afraid to speak, that fear 
- is present at a certain individualized level regardless of extraneous cir- 
cumstances in the classroom or situation. 

Students find videotape very useful in improving their speaking 
skills. It ^lso provides the teacher wi^h flexibility in, the evaluation of 
q the" g^tormances. It is hoped that classrooms and resources can be 
^I^C'founWb implement this mode of criticism on a wider basis. 
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. Who Should Make the Evaluations ' 

Throughout this discussion, several sources hav? been referred to as 
making comments and evaluations about the speaking performance. 
\ Just who should make those evaluations? 

The person most frequently used for evaluations is the teacher. 
Evaluation should be used as a serioijs teaching tool, and students seem 
to perceive it as being more serious if the teacher is involved. If the 
teacher can establish credibility with the students in the 'class, 
m maximum benefit can be obtained from the teacher's criticisms. In 
. giving oral comments, the teacher should strive to be a model of the ef- 
fective speaker. Students do not gain much from a teacher who uses 
the old adage ^Do as I say, tfof as I do." It is counterproductive for 
the teacher to criticize the student for engaging in a certain .kind of 
speaking behavior, while exhibiting the samel behavior that is being 
criticized. Teachers should serve as examples ajnd models for what the 
'students should strive for in their communication. 

Students learn what the teacher feels is important by the way 4 a 
. speech is evaluated orally. If the teacher constantly talks about delivery 
in the presentation of oral continents, the students will sooA pick up on 
the*idea that delivery is the most important thing to the teacher, 
feathers Shouk} avoid the tendency to comment only on picky things 
that are easily observed. Anyone can comment on eye contact, but 
sljdents probably profit more from comments and criticism regarding 
•organization; language, evidence, and so on, because these are the 
more abstract and difficult concepts. Studepts will probably concen- 
« trate on the areas that the teacher chooses to comment on, so those 
^ areas should be chosen carefully. % ' ' 

f Teachers are able to give new ideas on how to improve the speaking 
'performance. -Students sometftnes seem reluctant to value the comments 
of other students, because fellow students usually are not responsible 
for the grading. • » 

Teachers are also better able to present th0 students with a variety of 
approaches for the evaluation session. Most teachers Yealftethat no 
one method of evaluation works well all the time. Written comments 
. by the teacher can be used to reinforce oral Jcomments, and vice versa. 
Teachers can use 3 variety of rating blanks snd can vary the time when 

• tlft evaluation is given. By using 'a variety of methods, the teacher is 
more lively to help the mariy and diverse individuals who are members 
of the class. * 

Jf communication classes are to train good listeners as well as good 

• speakers, peer evaluation becomes essential. Few students can be told 
of the principles of good' evaluation and become good evaluators them- 
selves without having, practice in the skills necessary. If peer 

Q Juation is to be used, the teacher should spend some time in training 
ERXC student s in how to evaluate. It is particularly important that the 

* 2^ 
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* teacher deal with the issue of subjectivity in^aining peer evaluators. 
An evaluation is^a subjective response of one person, but with careful in- 
^ struction in the elimination of the halo error, the problem of subjec- 
*" tivity can be held to a minimum. If students are not trained, their 
evaluations are generally not specific enough to be helpful and can 
create some embarrassing situations. For example, the class may rank a 
speaker first out of all of the speakers of the day, yet t^e teacher's 
evaluation shows the student as earning a grade of D. This situation 
should and can be avoide*fby careful training of the class as evaluators, 
Several approaches to peer evaluation are available. During the last 
par.t of the class period, a student could" be asked to lead the class in an 
evaluation and discussion of the student performances of the day. Or a 
panel of students could be selected to discuss the speeches ofjhe day or 
the round. One student could be appointed in advance for each student 
speaker and the comments could be given after the speech. Students 
who are not speaking during a £lass period could* be asked to evaluate 
i all of th£ student speakers for the day by using rating scales. One 
student could be picked at the end of the day to summarize the com- 
^ ments'for the speakers. Student evaluators could be assigned by topics. 
Students who are having difficulty with, say, audience analysis, might 
be asked to- evaluate the speakers of the day on audience analysis. This 
strategy could also be done for delivery, organization, support, and so 
on. Students fculd then concentrate on areas where they too are having 
^ difficulty, , 

Class volunteers cquld also be used for the evaluation se&ion. Un- 
fortunately, thp same students are likely to volunteer for this task. The 
teachers should make sure that everyone in the class has an opportunity 
to evaluate at one time or another." The teacher could also call on in- 
. dividual students without notice and with the understanding' that 
anvone is likely to be selected to t>e the evaluate? for a given speaker or 
AS the day. This method helps keep everyone in the class attentive and 
actively listening throughout the presentations. Students might be 
asked to write short notes or paragraphs of evaluations of the speakers 
of the^day, and those comments can be given to the student speakers. 
Class members can also be asked to rank the speakers of the day, and 
the oral comments can be focused on why ope speaker was felt to have 
performed better than another. v ' 

If peer evaluation is used, the teacher should make sure that the 
comments are carefully controlled. That- is 'not to say that student 
evaluators should not be encouraged to speak their minds; however, i| 
should be done in a manner and form that is truly helpful to the 
speaker, and not downgrading or embarrassing. It is often helpful for 
the teacher to take some time to criticize the criticism. Such a 
discussion is particularly useful in the beginning of the cl^ss, so that 
O student speakers and evaluators alike understand the role of criticism 
ERJCI! in tfie speaking process and in the improvement of speaking skills* 
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The teacher should also take care that the student speakers are not 
overwhelmed by the peer evaluation. Particularly if the comments arfr 
given orally, a speaker could well be overwhelmed by the repeated 
comments of the class. Telling a student 19 times that the organization 
was unclear is probably not as useful as making the point only-once or 
twice and dieting other student comments into other areas. 

It cannot b* overemphasized that peer evaluators should be trained 
and instructed in how to apply carefully the developed criteria for 
evaluation before they are used in the classroom setting. Like the 
teacher, the students should be encouraged to develop precise and 
unambiguous language for evaluation. It is very frustrating for the 
student speaker tp be unable to ascertain just what the evaluator is 
saying, whether the evaluator tfa teacher or a peer. Instruction about 
precise language for evaluation can also carry over into the language of 
the student speeches. Skills used in learning to evaluate properly are 
also useful in learning to speak properly. This dual-purpose approach 
will not only help the evaluations and the speeches, but will al^o 
provide yet another example of the interrelationships of the parts of 
the communication process. ' 

Sometimes it is useful for student speakers to be able to evaluate 
themselves. As with peer evaluation, self-evaluation requires training in 
the application of the evaluation criteria. Several approaches might be 
used. The studenuspeaker might be asked to write down some reactions 
to her or his communication performance. Of particular help here is 
for the speaker to observe audience reaction, comment on what went 
well, what should be improved, what should be'done differently, and 
so on. 

Private conferences are Very useful in helping tjie speaker to become 
skilled v in the art of splf-evaluation.' The teacher might ask the"Ttudent 
to comment or assess the strengths andweaknessess he or she has as a 
communicator. Here againj* the teacher, through oral and written 
comments, can help direct the student's comments irito areas of con- 
structive criticism. It should be kept in mind that^he student comments 
about "self are t likely to take the same form as the teacher's or the 
class's comments. • ' 

Videotape -ft useful in self-evaluation. Even an audiotape might help 
the student assess the performance. If videotape can be used, the 
student could be encouraged to come in and view the student's own 
performance and rate it as if it were the performance of another. If the 
teacher can help the student with self-evaluation, the student can be 
given individualized treatment. In addition, the student who can engage 
in accurate, self-evaluation is likely to jengage in accurate .peer 
evaluation as well, so a dual purpose is served. 



3 Constructing an Evaluation Instrument 



Fdllowing are some suggestions for creating your bwn evaluation in- 
— strume&ts for use in the classroom. 

Create your scale to reflect what you teach.. This allows you to 
'measure behaviorally student achievement of the objectives and rein- 
forces the concepts that you consider important -enough to teach. Give 
the students a copy of the scale at the time you make the assignment so 
that they can have it they prepare their work. 

Define the meaning of each number to be assigned. Use a continuum 
to help studertfs understand how flie numbers relate to the definitions. 
In the following example, the student can see what a 7 means on the 
scale: 



Superior = among the best in the class 
Excellent = well above. average # 
Gopd '= above average, but could stand som^jmprovement 
Average = the norm for the assignment 
Fair = meets minimum quality standards 
Needs work = shourdffe^reworkecr^efpre presentation 
Inadequate = does not meet the assignment; insufficient 
preparation 

Phrase the cues in each trait so that all raters know what to look for. 
-Try to be as specific as possible in the space available. The better your 
description, the more valid your scale wilrt>e. 

Decide what type of rating scale you want to use. Trjere are several 
types from which to choose." The first is a numerical scale. This type is 
illustrated above. It simply asks rhe rater to choose a number to reflect 
the judgment of the trait. This would be useful for sliort assignments. 

The second type is a graphic scale, illustrated on page'27. It provides 
a line for the rater on which to make a mark. This line can either be 
calibrated with the numbers on it, or it can simply ask for the jnark. 
The teacher can go back later and assign numbers to the marks if 
scores are desired. 

The third type is a cumulative points scale. This type asks for a 
number in a series of Iraits and adds the numbers for a total score. The 
total score can then be turned into some kind of letter grade. This type 
q s illustrated on page 25. v " 
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7 = 

6 = 

5 = 

4 = 

3 = 

2 = 

1 = 
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The fourth type is a checklist scale, illustrated on page 31* It asks the 
rater simpty to check when Something was done or not done correctly. 
The total score is the number of correct checks. 

Leave enough space so (hat comments can be written. Even if there 
is not room for extended comments about each trait, space should exist 
.at the bottom of the scale for further comments. Some teachers use the 
back side of the paper for'exteitded remarks to the student. 

Designate a definite space for placing the numbers for each 
judgment. If numbers are usdd, it is important that raters know where 
to place their numbers, and where to record the total. 

Mqke a definite place available for the paperwork details. There 
should be a place to record Hems such as the speaker's name, the date, 
the assignment, the rater identification, and possibly the topic if you 
are evaluating a speech. 

There are several other considerations in constructing a rating scale 
. that will help in controlling some of the errors that have been discussed 
earlier. These are'considered in the following section. 

Controlling Rating Errors ' 

i * \ ' ^ 

* Placing each trait on a separate page will help control the halo error. 
The graphic scale on page 27 ff. incorporates this suggestion. It is harder 
to give a speaker consistently high or low ratings if you have to keep 
* changing pages. The disadvantage of this method is that it takes more 
paper. 

Trait errors, can be controlled 8y the phrasing of the description of 
the cues: The descriptions should be characterized by claijty, 
' uniqueness to the trait, precision, and objectivity. These characteristics 
will help control the'trait errdVs and make the scale more valid. 

The error of central tendency can be controlled by the number of i 
scale values used on the continuum. For example, if^only three num- 
bers are used,j^st raters are going to use the middle category; It has 
- been foiuflf that a fiye-step scale usually results in three steps being 
^used." A seven-step ^scale* uses about four. A ten-step scale usually 
produces five. One way to get raters to use more of the scale is to have 
more'steps. The other method that has proven useful is ,tor discuss the 
-error and to caution raters against it. 
9 r Do not place traits that are logically related next to one another on 
the scale. If delivery and content traits are listed alternately, proximity 
• , error has Jess chance to operate. Another effective way to control the 
logical error is to discuss the error with the raters and caution against 
it. • * 

Overall, warning the raters about the various^ errors is a practical 
, way of controlling them. However, Repeated warnings are usually 
Q lecessary a$ tiniq goes by "and students (and teachers) are often rushed 
£ J^JC 11 ^ therefore likely to forget the warnings under pressure. 
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4 Evaluation Forms 

The following pages dbntain sample evaluation forms- that may be 
useful in various kinds of classrooms, Their intended uses are described 
below. ~" 

#1— Introduction Rating Scale. This form is used for evaluating the 
introduction in a speech. The assignment is to present a one-to-two- 
minute introduction to a speech. Eveq short assigfiments like this 
deserve to be evaluated. 

#2— Speech Rating Scale. This scale is used to evaluate both infor- 
* mative and persuasive speeches. It was originally used at the University 
of Iowa, but has undergone extensive revision based on our research. 
The subquestions in each category serve as criteria for making the 
judgment about the category, and provide helpful information to 
raters. t 

#3— Consolidated Speech Rating Scale. This form proves useful after 
all raters have become familiar with the previous form. Its intent is 
strictly practical — to save paper. Note that six speakers instead of one 
can be evaluated on one page. If students are rating one another and 
there are 20 students in the class, it takes approximately 400 pieces of 
pap$r to have each student rate every, other student? Of course, there is 
less room for comments when six speakers are rated ^er page. 

H — Graphic Scale. This is a graphic scale developed from our 
research. It is also useful in large classes because the number of 
speakers per page can be increased. It has also been used in a number 
. of research projects. Scores are given by assigning a 5 to the highest 
description on each page, the next a 4 and s o on until the lowest des- 
cription is assigned a I. 

#5.— Technical and Professional Speech Rating Blank. This scale has 
been used in a special course emphasizing business speaking. Here, up 
to sixteen points can be assigned per category. The grade is then based 
r -on the total score derived by addjrig the category scores. The comments^ 
on this particular scale are made on the back of the sheet. Students are 
also encouraged to answer each of the questions on a yes-or-no basis in 
each category. 

Speech Rating Blank. This scale was developed and tested in a 
middle school classroom. Its strength is that it only asks for yes-and-no 
judgments. It should be noted that any of these forms can be used at 
the elementary and middle school levels. Jt is a matter of adapting the 
language and the criteria, rather than the entire form. 

#7_ o ra i Interpretation Rating Blank. This scale was developed for 
use 'in evaluating oral interpretation assignments. Note that it has more 
© itegories because it is used in a special situation. Many people do not 1 
ERJ^Cke to use numbers when evaluating oral interpretation, but our re- 
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' search shows that it has worked just as well as letter grades. 

#3— Communication Objects Rating Scale. This is an example of 
how rating scales can.be used in interpersonal communication assign- 
ments. The assignment asks each student to' use several objects to ex- 
plain different aspects of their self-concept. Here a total score based on 
the categories is used for a grade. 

#9— Group Project Rating Scale. Here is an example of a small 
group application df rating scales. This can be used'to evaluate each 
member of the group or the group as a whole. Since many things are 
going on at once in a group, the number of criteria has been re- 
duced. The teacher cannot pay sufficient attention to many details for 
o six people all speaking more or less at once. 

#10— Speech Performance Scale. This scale uses live points per 
category as the basis for the, total score, it also adds the checklist 
method if students are instructed to check the criteria that apply in 
each category. The original form was developed by speech scholars and 
authors A. Craig Baird and Franklin Know^r, and has been modified 
through research. ' 

#1 1— Mini Teaching Evaluation Scale. This scale is useful in helping 
to evSluate prospective teachers or student teachers. The assignment is 
to teach a part of a lesson or unit. The critic teacher then can use the 
form to guide the evaluation of the student teacher. If the student 
teacher is given the scale ahead of time it also serves as a preparation 
guide for the lesson. 

#12— Observational Project Evaluation Scale. This scale Ms used in 
nonverbal communication. The 0 assignment is to observe several in- 
teractions among two or more people. The student must then orally 
report on the conditions under which the interaction took place, each 
person's perceptions of the conversation, the reinforcement techniques 
used by each, and the resultant attraction between the individuals. Also 
the student must select a type "of outcome that resulted from the 
interaction . ' > 

#13— Short Speech Feedback Form. This form is shortened in that is 
cqntains fewer cues on how to evaluate each category. It has more 
space for written comments, however. This form is useful in later 
assignments when evei^one is familiar with all the criteria in each 
category. ' % X 



Overall Comments * 

It should ht noted that any of these forms can be extended by using the 
back of the page for further comments. Comments are yery helpful for 
the student, and the evaluator, whether student or teacher, should be 

couraged to use the back of any of these or other rating forms for 

pensive comments. 



#1 Introduction Rating Scale 



Speaker 



Date 



Comments Score 



Attention 

Does the introduction attract favorable 
attention? , 

Are the attention factors obvious? * 

Topic , 

Does it state the topic clearly? 

It is obvious on which side of the topic 
the speaker stands? 

Lead in 

Does it lead into the body bf the speech? 

Are the main points to come clearly 
stated? 

Is it clear where the speaker is headed 
with the topic? 

Credibility 

Does the intrp establish initial credibility? 

Does the speaker use the sources of 
credibility? 

Delivery* 

Is the speaker communicative? 
Was the eye contact direct? 
Were the gestures meaningful? 

Total 



10 

superior 



7 

average 



Total Point3 39-35 = £ 
G \S = A 34-30 = D 
ERJC » = B 29-00 = F 



inadequate 
Comments: . 



1 

poor 



30 



I.D.# 
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Speaker 
Subject 



#2 Speech Rating Scale 

• Date 



Assignment. 



Items 



Comments 



Score 



Organization: Clear arrangement of ideas? 
Introduction* body, conclusion? Was there 
an identifiable pattern? 






Language: >Clear,* accurate, varied, vivid? 
Appropriate standard of usage? In conver- 
sational mode? Were unfamiliar ternjs 
defined? 






Material: Specific, valid, relevant, suf- 
ficienu interesting? Properly distributed? 
Adapted to audience? Personal credibility? 
? Use of evidence? 




- 


Delivery: Natural, at ease, communicative, 
direct? Eye contact? Aware of audience 
reaction to speech? Do gestures match voice 
and language? 






Analysis: Was the speech' adapted to the 
audience? Did the mqin points support the 
' purpose? 






Voice: Varied or monotonous .in pitch, in- 
tensity, volume, rate, quality? Expressive of 
logical or emotional meanings? 







Total 



Scale: 



10 

superior 



7 

average 



ERIC 



inadequate 



1 

poor 
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#3 Consolidated Speech Rating Scale 

1 2 3 ^ ' 4 5 6 



Name 



Organization 



Language 



Material 



Delivery 



Analysis 



Voice 



Total 



Evaluatorl.D.*. 




H Graphic Scale 

Directions Place your I.D. Number here*. _ 

1. In the following pages there are four rating sheets, one for each of 
four traits of communication. 

2. Each of the rating sheets has four vertical lines which represent 
four speakers. 

Rate each speaker, according to th\ descriptions which you feel 
most nearly apply, 6y placing an AT on the speaker's vertical line in 
a position corresponding to the description. 
Use all four rating sheets for each speaker. 

Use only one line per speaker per sheet— that is, rate speaker 1 oa 
line 1 on all four traits, rate speaker 2 on lme*2 oh all four traits, 
etc. V 
•These ratings shpuld reflect your honest judgment of the com- 
municative act. 
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3. 

4. 
5. 



Ideas' 4 * I 

Ideas significant to the audience; ideas .well 

adapted to the audience; assertions well sup- v 
porug; creative treatment of ideas; . well 
analyzed on all points. 

Ideas significant to nfljft of the audience/ 

mostly well adapted to the audience; most 
assertions supported; mostly creative treat- 
ment otideas; sound analysis on most points. 

Ideas partially significant to the' audience; 

partial adaptation to the audience; some 
*assertions i supported and some not supported; 
average creativity in treatment of ideas; 
average analysis of ideas. 

' Ideas not very significant to fhejaudience; 

ideas not very well adapted to the audience; 
most assertions not supported; little 
creativity in treatment of ideas; weak 
analysis of ideas. 

Ideas not significant to the audience; ideas 

not adapted to the audience; assertions not 
supported; trite treatment of ideas; very 
shallow analysis. 

Organization • 

Arrangement easy tp follow; planning of 

organization very evident. * ^ 

Arranged overall but unclear on a few points; 

planning of organization obvious. 

— —Some points arranged and some not ar- 
ranged, but can, be folloWbd with some ef- 
fort; planning of organization obvious, but 
not in all places. 

Arrqpged in places, but generally hard to 

follow; planning of organization was hard to ' 
' see. „ 

Unarranged and difficult to follow; planning 



Voice and gestures inappropriate to the ideas* 

of the speaker; adapted to audience and 
situation; free of distractions in voice and 




Delivery 



gestures 
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Delivery (cont) 

Some inappropriate use of voic^ and 

gesture^ in terms of ideas; predominantly 
adapted to audience and situation; some dis- 
tractions evident in voice and gestures, but 
not to the extent of diverting attention from 
content. t 

Voice and gestures sometimes reflect the 

speaker's ideas; adaptation to audience and 
situation evident, but not throughout the 
speech; voice ( and gestures sometimes 
distract from the ideas. 

Voice and gestures inappropriate to the 

speaker's ideas in many places; voice and 
gestures not very well adapted to audience 
and situation; frequent distractions from 
content because of voice and gestures. 

Voice and gestures not really appropriate to 

the ideas; voice and gestures not adapted t<$ 
audience and situation; distractions from 
content because of voice and gestures are 
prevalent. 

Language ' <• 

Concise, varied, and vivid use of language; 

well adapted to the level of the audience and 
' thfe topic. f * 

Language usage partially concise,- varied, 

and vivid; partially adi^ted to the level of 
the audience and the topic. - * 

Language usage predominantly concise, 

varied, and vivid; mostly adapted to the 
level of the audience and the topic witfc few 
exceptions. 

— — Language usage partially concise, varied, 
and vivid; partially adapted to the level of 
the audien ce and the topic, 

Language usage not very concise, mostly 

unvaried, and not very vivid; ^adapted to the 
level of the audience and the topic only in 
some places. - / 

" Language usage wordy, the same tfrough- 

out; dull; not adapted to the level of the 
audience and the topic. 
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#5 Technical and Professional Speech Rating Blank 



• 

1 . Audience analysis 

1. Were th? materials adapted to the audience? . * 

2. Was the topic adapted to the audience? 

3. Was the purpose suitable, in terms of the audience? 


Score 


2. Organization \ 

l s Were the iqeas organized into a logical format? 

2.. Were there transitions between parts of the presentation? 

3. Was the central idea clear? 

4. Were the introduction and conclusion sufficient in terms 
of the structure and the presentation? 




3. Credibility 

1. Did the speaker establish credibility early? 

2. Was the 'speaker aware of the various methods of estab- 
lishing credibility, as. evidenced by the presentation? 

3. Did the speaker attempt to maintain credibility through- 
v out the presentation? 




4. Research and knowledge 

1. Were the ideas supported adequately by evidence? 

2. Was research evident, or was the presentation based upon 
personal experience and supposition? 

3. Were questions handled well? 

4. Was there a variety of supporting material? 


• 


5. Delivery ^ ^ 

1. Was eye contact m&intairrcd throughout the presentation? 

2. Was there an attempt at meaningful movement and 
gestures? 

3. Was the delivery appropiate for the presentation? " 




6. Overall presentation (every^ member of the group receives 
, the same grade here) 

1. v^noice.oi suDject 

2. Continuity . f 

3. Accomplishment of purpose 

4. Establishment of credibility 
i 
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excellent above average average below average poor 
16 12 8 , 4 1 1 

Group Number 1 Total Score 

Speaker , 

ERJC lu f tor : 35 

: i , : '. 



#6 Speech Rating Blank 

Name , ! Date __ 

Subject of the Speech ! ! Teacher — : 

After you listen to each of the speakers, answer the following questions 
with a yes or a no. These questions will be, used to help us decide which 
areas are important to us when preparing to give a speech, and how we 
may improve otlr speeches in*the futuj^ 

Organization — how the speech is put together or,arrangecfc^ 

1 . Could you -easily pick out the main ideas of the speech/! , 

2. Did the speech have an introduction? , 

. 3. Did the speech have a body? 

4. Did the speech have a conclusion or summary? I 

5. Was the speech developed or put together in a way that made it 
easy for the audience to understand? : 



Language— the Ventence structure of each speech. 
I* Were the explanations clear? 



2: Was the language easy to understand? 

3. Did the speaker make use of pauses to separate ideas from one 
another? r_L 

4. Were there too many and's or uh's used? 



5. Wa£ it easy to tell where one sentence stopped and the next ftne 

began? y ^ * 

Material—what the speech was actually about. 

l.\Was the. subject interesting to you?. 



as the speech easy for you to,understand?_2_-j : — 

d the speaker seem really to know the subject matter?. 



4. Did the speaker seem comfortable and at ease while giving the 
speech? 0 • 

5. Was there eye contact with the audience?. 



6. Was the speaker aware of how the jaudience was reacting to ttte 
speech? I \ 9 » * * * 

7. Did the speaker make good use of gestures and body language? — ^ 

8. Did the main idea stand out above the other ideas?. 



9. Were there otherldeas less important but still necessary in the 

development of the speech? 1, : 

Voice — how the speaker sounded. ^ 



1 . Was the speaker's voice pleasing to the ea'r? 

2. Was the pitch varied—that is, did it go up and down?. 

3. Was the speaker lflud enough? . 

4. Did the speaker talk too fast? 



Did the speaker use good expression? 

^r-tal Score A_ (add the number of "yes" responses) 
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m Oral Interpretation Rating Blank 

Reader Assignment JTotal Score. 



1. Introduction; Captures attention, sets the scene 
\ and mood, gives needed background, inform- 
ative. > 






2. Material: Of interest to the audience? Is it 
adapted to the reader, assignment, occasion, 
and audience? Proper cutting? 






3. Eye contact: Does the reader try to reach each 
member of the. audience? Is -there too.mucji 
dependence on the manuscript? Is there effeo- 
uve cnaracier placement;, V 






4. ^Articulation and pronunciation:, is it clear, 
correct, slurred, muffled? Are there defective 
sounds? Acceptable standards of pronunciation? 






5. Facial expression: Appropriate, varied, adapted' 
to the reading? Does it .aid in expressing the 
emotions in the selection? 




• 


6. Poise: ' Confident, at ease, personality pleasing 
moves easily, projected to the audience? Aware 
of audience reaction to the reading? » 






7. Bodily action: Is the reader animated? Are 
posture, action, and gestures constructive or 
dStracting?/ Are gestures used effectively, 
varied, suited to content anc^jrpose? - 






8. Vocal quality; Is it pleasant tf> listen to? Is 
therq sufficient variety, projection, clarity? Ac- 
ceptable volume? 






9. Rate and timing: Arfe rate and pauses varied 
and suited to content and purpose? Too fa$t or 
too slow? 






10. Content:, Communicated author's intent * as 
stated in the introduction? Was the content 
adequate to support the reader's goal as stated 
in the introduction? 







10 9 8 « 7 6 
superior average 

ERIC tional Comments: 



5 4 3 
inadequate 



2 1 
poor 



Score 





\ 
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#8 Communication Objects Rating Scale 






Nam* nf rnmmnntriitnr 






1. How well was the self-concept explained? 

i i i i i 




1 


superior excellent above average fair 
^ average 


below 
average 


poor 

• 


2. How well was the concept of what others think explained? 
I I ! II 


i 


superior excellent above average fair 
average 


below 
average 


poor 


3. How well was the ideal concfept explained? 

i i i i • i 




I 


superior excellent j above average * fair 
average 


below 
average 


poor 


4. How well was the undesired concept explained? 

i. • i i i 




i 


superior excellent above average fair 
average 


below 
average 


poor 



5. How well are the differences among the four objects clarified? 

I I J— I I L_ 

superior excellent above average fair below ^K>or 
average average 

6. How weir do- you think the communicator was prepared? 

I I I I I L_ 



superior excellent above average . fair below. poor 
^ average average 



Name of Evaluator. 



ice other comments on back of sheet. O o 
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#9 Group Project Rating Scale 



Group , Name . 



> Topic Selection— Did the topic relate to communication? Did the topic 
draw some new relationships about the way com- 
munication is used? Was the topic worthwhile? 



1 5 10 15 20 

Organization— Did the project seem well organized? Did the order 
make sense? Was a pattern built into the presentation? 



1 5 ' 10 15 20 

> Participation— Did all group members play a significant part in the 
* presentation? 



1 4 - 10 u- 15 ¥ 20 

Quality— If all groups made presentations similar to this one in Quality 
would this be an excellent way to learn about ^com- 
> munication? 



1 - Y . 5 10 15 20 

Creativity— Did the group show unusual thinking in the method of 
presentation? 



1 5 10 15 20 

\ ' 

Total Score y 

Comments: 
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#10 Speech Performance Scale 

Name of speaker Date ! 

Hvaluafnr Section 

Speech Topi& I 

Instructions: Please rate each of the six / categories below on the 
following 1 to £ scale: 'l equals poor, 2 equals fair, 3 equals average, 4 
equals good, 5 equals superior. Use the criteria under each of the six 
categories as a basis for your rating. Also rate the speech on General _ 
Effectiveness in the special box at the bottom of this page. 



Criteria 


Rate 
1-5 


Delivery: 

Easily audible Good pitch Varied 

Not forced Pleasant quality Conversational 

Good rate r Fluent , Acceptable 

Clear R<£ponsive ^Well controlled 

Adaptive 




Language: 

Acceptable Vivic^ Varied 
Precise Vigorous Unified 




A udience Interests and Adaptation: 
Attention aroused * 

Interest maintained Knowledge considered 
Confidence Beliefs considered 




Ideas: ■ 

Acceptable purpose Well developed Interesting 
Clear central idea Accurate Creative 
.Well supported Clea? Significant 


* 


Organization:, t 
Well introduced * Clear transitions 
Well divided Well arranged 
Well concluded # 




General Effectiveness: 

Mark on a 1 to 5 scale in the box at the rightlfre overall 
( ^ -'fectiveness of this speech. 





:I\IjC r rite additional comments you may have about thejp^bch on the back 



this page. 



Objectives ' : 

Were the objectives clear? Were the objectives measurable? 

Were the objectives.significant? 

Comments: # ' 

Strategies , - 

Were the instructiohs clear? Was the strategy appropriate to 
the objectives? Was the strategy interesting? Was the strategy 
well implemented?- • \ 
Comments:' '** 

Evaluation - ' . * 

• > n - 

Could the objective attaitiment»be evaluated? Was some sort 
of evaluation implied 'in the lesson? ^ » 

Comments; < 

Wer^Ufe methods of fe^lradk about* the situation implied? 

Coufd the lesson*be evaluated by thi teacher? 

Copiments: 
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Hi , Mini Teaching Evaluation Scafe 

- t 

Preparation * ' " , Rating 

Was a t lesson* plan prepared? Was the lesson apparently * 
prepared ahead of time? Was the teacher prepared for this 
lesson?* * ' »~ 

Comments: • " • 



Capabilities „ * e 

-Was the material ^appropriate for the^ grade level specified?, 
Would the material work in a classrodm at the grade level 
specified? . . - 

Comments: 



Total 



* Instructions * ' 

Rate each, of the categories above by placing the number corresponding 
to your evaluation. Use the, following scale.* 

5 = Outstanding — This asp&t of the Iessop was clearly in a superior 
range. 

4 = Above 'average — This aspect was well done andywould work 
O well in a class. 
ERJ C Average — This*spcct was solid and would be accqrtable in a 
classroom. . Q\ 



2 = Below average — Needs some wbrk before taken into the 
classroom. 

1 =s Improvement — Would require substantial revision before 
taken to the classroom. 

#12 

Observational Project Evaluation Scale 



Type of Outcome 

Conditions 

Description of conditions 
•Explanation of the results 



Perceptions 

Was the outcome successful or unsuccessful? 
Verbal behaviors 
Nonverbal behaviors 



Reinforcement Techniques 
Description 
Conclusions 



Attraction 

Basis of attraction 
Negative attraction * 



Comments: 



Scale 

5 __4 3 2 1 

superior 1 above average below inadequate 

average average 



i 

Points 



Total Points 



42 
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#13 Short Speech Feedback Form 



* Name: * Topic: 



Item 


I 


2 


3 


4 


Comments 


Clearly stated thesis 












Examples 

Direct support 
Clear explanation 












Eye contact 










• 


Gestures 












Body position 













i 



Evaluator Grade 



Key: 1 = Needs a lot of work . 

2 = Doing well some of the time, 

3 = Doing well most of the time, 

4 = Excellent job— keep it up, 
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